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"*Ij ' Abstract 

This paper studies controllability properties of recurrent neural networks. The new contributions 
are: (1) an extension of a previous result to a slightly different model, (2) a formulation and proof 
of a necessary and sufficient condition, and (3) an analysis of a low-dimensional case for which the 
hypotheses made in previous work do not apply. 
> 

m 

^ ; 1 Introduction 

(N. 

^D . This paper deals with controUabiUty properties of what are often called "recurrent neural networks" . 

These constitute a class of nonlinear systems which, although formally analogous to linear systems, 

^ij . exhibit interesting nonlinear characteristics and arise often in applications, see e.g. [3, 4, 5, 7, 9, 10, 11, 

i-Q ' 14, 15, 18]. A general model of recurrent nets (see e.g. [15]) is as follows. Assume given a Lipschitz map 

C^ . : R — > M. The most typical choice is 

^x o — a: 

0{x) = tanha; 



e-^ + e 



k> I which is also called the "sigmoid" or "logistic" map. For each positive integer n, we let 0*^"-' denote the 

j_( ' diagonal mapping 

gin) : R" ^ R" : : \ ^ \ 

\Xn/ \0{X„ 

Definition 1.1 An n-dimensional, ?7i-input recurrent net (with activation function 6) is a system with 
state space R" and input-value space M™ respectively, and equations of the form 

i{t) = e^-^UAxit) + Bu{t)) , (1) 

where A e M"^" and B e M"^™. D 

Since ^'^"■* is a globally Lipschitz map, such a system is complete (every input is admissible for every 
state). For general terminology about systems and control, we follow [13]. In system-theoretic terms, 
we may represent a net by means of a block diagram as in Figure 1. 

* Supported in part by US Air Force Grant AFOSR-97-0159 
t Corresponding author 



B 



^ 



0(r^ 



A 



Figure 1: Block diagram of net 



Observe that, if we had 6 = the identity function, we would be studying continuous-time time- 
invariant hnear systems. However, in this paper 9 wiU be bounded, which excludes that case. One 
manner in which recurrent nets arise is when modeling situations in which rates of change of state 
variables are bounded or saturated (we may use tanh to impose \xi\ < 1). In the field of neural networks, 
one thinks of the coordinates of x as the describing the time-evolution of an ensemble of n "neurons," 
and the entries Aij and Bij as "synaptic strengths," of the connections among neurons; in that context, 
6* : M ^ M is called the "activation function" . 

The paper [1] initiated the study of controllability properties for recurrent nets, and provided con- 
ditions for the "forward accessibility" of such systems. In [16] -see also [13]- a sufficient condition for 
complete controllability was obtained, and this condition is reviewed below. One of the contributions of 
this paper is to show that the condition in [16] can be turned into a necessary and sufficient condition 
for a stronger form of complete controllability. 

There is a formal variant of the model given in the above definition, also sometimes referred to as a 
"recurrent neural network" , namely as follows. 



Definition 1.2 An n-dimensional, ?n-input input-affine recurrent net (with activation function 9) is a 
system with state space M" and input-value space M™ respectively, and equations of the form 



x{t) = A9'^''^{x(t))+Bu{t), 



where A G 



and B £ 



(2) 

D 



The block diagram representing such a system is as in Figure 2. 

u 




Figure 2: Block diagram of input-affine net 



As often remarked, see e.g. [2], it is sometimes possible to obtain results for input-affine recurrent 
networks from analogous results for (non input-affine) nets, by means of the change of variables z = 
Ax + Bu. It is important to observe, however, that, under such a change of variables, one obtains 
equations of the form i = A9^'"''{z) + Bv, where the new control v is the derivative of the original 
control. Thus, a solution x(-) corresponding to the action of non-diffcrentiable (for instance, piecewise 
constant) u cannot be seen always as a trajectory of the new system; indeed, the function z will in 
general not be even absolutely continuous, so "i" does not make sense. In addition, the feedback change 
of variables {x,u) h^ {Ax + Bu,v) can fail to be invertible because the matrix [A, B] does not have 
full rank (so not every state z can be written as Ax -\- Bu for some x and u). In summary, obtaining 
results for input-affine nets by this transformation is not completely trivial, and some work is required 
when following this approach. In [2] , it was shown how, for questions of parameter identification, this 
transformation can be fruitfully applied. Another of the contributions of this paper is to follow this 



approach in order to provide a controllability result. It turns out that a recent and nontrivial result 
about nonlinear controllability, from [6], is instrumental in the proof. 

Finally, at the end of this paper we return to the model (1), and provide a complete characterization 
of controllability for recurrent nets in the two-dimensional case. 



2 Statements of Results 

Given any continuous-time system x = f{x,u), we write (j){t,x'^,u) for the solution x{t) corresponding 
to the initial state state a;(0) = a;" and the measurable (essentially) bounded control u : I ^ R™, where 
/ ~ [0,T] or / = [0,oo). For those systems that are considered in this paper, solutions exist globally 
and are unique, so this is well-defined for all (i,a;°,u). (See [13] for generalities and basic facts about 
control systems.) We also write 4'{t,x,u) as 4'u{t,x) or 0^(a;), depending on the context. 

As usual, given any two states x^^^x , we say that x° can be steered, or controlled, to a;' if there 
is some T > and some control u on [0,r] such that the solution is defined for all t E [0,T] and 
(j>{T,x'^ ,u) — x^ . A system is controllable if every state x^ can be steered to every other state x^ . 

For each pair of positive integers n and m, we introduce the following open and dense subset of the 
set of all n by TO matrices: 

B„,™ := {B e M"^™ I (Vi) TOWi{B) ^0 and (i i ^ j) rowi(B) ^ ±tow^{B)} 

where rowi(-) denotes the ith row of the given matrix. Observe that, in the special case ?n = 1, a vector 
b G B„^i if and only if all its entries are nonzero and have different absolute values. 

Finally, we let 8 be the set of all functions : M ^ M which are Lipschitz and have the following 
properties: 

1. 6 is an odd function, i.e. 0{—r) — —0{r) for all r G M; 

2. 6oo — linis^+oo 0{s) exists and is > 0; 

3. e{r) < 6*00 for all r eR; 

4. for each a,b eM., b> 1, 

r gpo - 0{a + bs) 

lim — ^7^^ — =0. (3) 

s^-l-oo 9oo - 0{s) 

The activation function which appears most frequently in applications is 6 ^ tanh, so the following 
result from [16] is worth mentioning: 

Lemma 2.1 The function tanh G Q. 

We recall the main result from [16]: 

Theorem 1 Assume that 6 E O and B G B„ ,„. Then the system (1) is controllable. I 

In order to state a necessary condition, we need the following concept, which we define for more 
general systems. 

Definition 2.2 A system x — f{x, u) is strongly locally controllable around a state x^ if for each neigh- 
borhood V of x'^ there is some neighborhood W of a;°, included in V, so that, for every pair of states y 
and z in W, y can be controlled to z without leaving V. □ 



This definition amounts to the requirement that any two states which are sufficiently close to x'^ can 
be steered to one another without large excursions; see [13]. We will show, in Section 3: 

Theorem 2 Assume that 6 E O. Then the following two properties are equivalent, for (1): 

1. B e Bn,m- 

2. The system (1) is strongly locally controllable around every state. 

If a system with connected state space (as is the case with recurrent nets, whose state space is M") is 
strongly locally controllable around every state, then it is clearly also completely controllable. (Strong 
locally controllability around x^ implies that the reachable set TZ{x^) is both open and closed.) In fact, 
the proof of Theorem 1 given in [16] already establishes strong local controllability. Thus, wc only need 
to prove the necessity of S e B„ m. 

We now turn to input-affine nets. The main result, to be proved in Section 4, is: 

Theorem 3 Assume that 9 gQ, rank [A, _B] — n, and B G B„^„i. Then (2) is completely controllable. 

Finally, in Section 5, we will return to the model (1), and ask now what can be said if the hypothesis 
that B G B„^„i is dropped. In general, obtaining necessary and sufficient conditions for controllability 
when B ^ B„ „, appears to be a very difficult subject. We will, however, provide a complete solution 
for two-dimensional single-input {n = 2, m = I) systems. 

3 Proof of Theorem 2 

We start with a general observation. 

Lemma 3.1 li B ^ B„ „i then there exists a nonzero p G M" so that 

signp"^ 6'(") (Ax + Bu) = sign p^ Ax 
for all {x,u) G M" x M™ (with the convention signO = 0). 

Proof. We denote, for each i, hi :— rowi{B) and a^ :— rowi(^). There are three cases to consider: (1) 
some hi = 0, (2) hi — bj = for some i ^ j, and (3) bi + bj = Q for some i ^ j. 

In the first case, we let p :— ci iiih canonical basis vector). The conclusion follows from the equality 

ej e^'^^Ax + Bu) = e{aix) 
and the fact that sign 0(f) = v. In the second case, we let p := e^ — Cj. The expression 

{ci — Cj) 6^^^' {Ax + Bu) = 6{aiX + biu) — 6(ajX + bju) — 6(aiX + biu) — 6{ajX + biu) 

is nonnegative if and only if aiX > ajX (using that 9 is monotonic), that is, when p Ax — aiX — ajX > 0, 
so also in this case we have the conclusion. Finally, if bi + bj =0, we pick p := Ci + Cj. Then 

(ci -|- Cj) 6^"' {Ax + Bu) = 6{aiX + biu) + 9(ajX + bju) = 6{aiX + biu) — 6{—ajX + biu) 
(since 9 is odd), which is nonnegative precisely when (a^ + aj)x > 0. I 

We now complete the proof of Theorem 2. Suppose that B ^ B„^m- Let p be as in Lemma 3.1 and 
let V be M" if p"""^ — and {x Ip^Ax > 0} otherwise. Pick any state x^ G V. Let TZv{x'^) be the set of 
states reachable from x'^ without leaving V. Then TZ\;{x'^) is included in the half space 



(xIp'^x >p'^x^\ 



This is because, if ^ == e'(")(AC + Blo) and ^(t) e V for all t, then 

j^P^m = P^e^'^HAm+Bioit)) > 0, 

so the function ip{t) :— p^(t) is nondecreasing. Thus, there cannot be any neighborhood of x^ which is 
reachable from x° without leaving V. This completes the proof of the Theorem. I 



4 Proof of Theorem 3 

We start by reviewing a very useful notion. We consider systems x ~ f{x,u) for which the state space X 
is an open subset of some Euclidean space R" , the input-value space 11 is a subset of R™ , / is continuously 
differentiable on x and / and fx are both continuous on (x, u). 

Given x'^,x G X, one says that x is normally reachable from x^ (with piecewise constant controls) 
if there are control values Ui, . . . ,Uk G IX and switching times ti, . . . , t^ e R>o such that 



'<(x°)=xf 



e.o-. "-*^-°^--f 



and the map 

is nonsingular (i.e., its Jacobian at this point has rank n) at (ii, . . . , tk). If x' is normally reachable from 
x", for all pairs x'^,x^ G X, we say the system is globally, or completely, normally controllable. It is easy 
to see that the notion of normal reachability has the following transitivity property. 

Proposition 4.1 If y is normally reachable from x, x is reachable from z with piecewise constant 
controls and w is reachable from y with piecewise constant controls, then w is normally reachable from 

z. a 

Of course, normal controllability implies controllability. A fundamental result in control theory makes 
a converse statement: 

Theorem 4 [6] Every completely controllable system is also completely normally controllable. I 

The main technical fact that we need is given by the next result, which says that controllability 
is preserved under "backstepping" or "adding an integrator" ([8]). This result is a counterpart of the 
well-known theorem which asserts that stabilizability is preserved under backstepping, cf. [13], Chapter 
4, but the proofs are very different. The critical step is showing that if a system is controllable then it 
is controllable using differentiable controls with prcassigned boundary values. The technique of proof is 
almost identical to the one used in the much older paper [12], where it was shown that analytic systems 
are controllable using infinitely differentiable controls. We may now remove analyticity assumptions, 
thanks to the recent result that was cited in Theorem 4. We should point out, also, that the special case 
of the result for "systems without drift", was previously given in [17]. 

Theorem 5 Suppose that the input-value set IL is open and connected. Then, x — f{x,u) is completely 
controllable if and only if the cascaded system 

X = f{x,y) 

y = V (4) 

with state space X x U and control space R™ is completely controllable. 



Proof. If the cascaded system is completely controllable, it is clear that the x-subsystem must be as well. 
We now prove the other direction. Assume that x = f{x,u) is completely controllable; Theorem 4 then 
says that the system is completely normally controllable (with piecewise constant controls). Take any 
x'^,x^ e X and any y'^,y^ G 11. We will show how to control {x'^,y^) to {x^,y^). 

Pick £o > small enough so that both 0(eo, a:;°,y°) and (p{—eo,x^,y^) are defined, were we wrote y" 
and y' to denote the constant controls taking values y" and y' respectively. Let x" := (?!)(eo, a:;^, y°) and 
x^ := 4'{—eo,x^,y). Using that the x-subsystem is completely normally controllable, in particular x^ is 
normally controllable to x^ . Thus, there exist fc, Ui, . . . , u/,, and ti, 



,th ^ 



^>0i 



such that 



,Sk) 



0^*= o. . .0 0^1 [x ) is nonsingular at (ti, . . . , t^). Applying the Inverse Mapping 



and the map (si. 

Theorem, we conclude that there is some neighborhood V of x^ and C^ functions si 
such that 



rsk-.v 



^>o 



for aU z ^V. Let V := 4>'^°{V), and define si,. . . ,Sk :¥ 



^>o 



by 



for i ~ I, . . . ,k. Then, 



Sj(z) := Sj(</)(-£o,/,z)) 



</'^?°Cf^°---°C/'^°C°(^°) ^ ' 



for all z G y. Because U C M™ is open and connected, we may find a differentiable curve 7 : [0, k+l] 
such that 7(0) — y°, 7(fc + 1) = y^ and 7(4) = u^ for i = 1, . . . , A:. Define a; : y x M ^ R as follows: 



U 



w(z, t) 



Then, we have 

for all z E V. 



' t < eo 

1 £0 <t < So + si{z) 

k So + si(z) + . . . + Sk^i{z) < t < So + si{z) + . . . + Sfe(z) 

_ fc+1 So + si{z) + . .. + Skiz) <t. 

<l>{2so + si{z) + ... + Sk{z),x°,-f{uj{z,-))) = z (5) 

^ M, Z = 1, 2, . . ., so that the following properties, for 



We now choose a sequence of functions p; : M - 
each I: 

• Pi is C°°, 

• pK*) > for aU i e M and p(t) = for all \t\ > j. 

For instance, one could take 

C 1 



p/(i) 







1^1 <T. 
otherwise, 



where q is an appropriate normalizing constant. 
We introduce, for each I, the function 

uji : V xR : {z,t) 1-^ / uj{z, T)pi{t — T)dT . 

Jm 

This is smooth in i, and the following properties hold: 



1. uji{z, t) e [0, A: + 1] for all /, z e F and t e R. 

2. For each z G F, wz(z, t) ^ uj{z, t) only if t — eo ^ X]i=i SiC-^) < j for some j, j = 0, . . . , fc. 

3. uJi{z^ 0) = and loi{z^ 2£o + sx{z) + . . . + Sk{z)) = fc + 1 for all z G 1/ and all / > — . 

Note that the functions 7(0;; (z, •)) are valid controls, as they take values in U, because of 1. Moreover, 
the values 7(0;; (z, t)) belong to a compact subset K of U, namely the image of 7, for all t and z G F. 

We claim that 

hi(z) -> (/)(2£o + si(z) + ... + Sfe(z),a;°,7(cj(z,-))) = z (6) 

as ^ ^ 00, uniformly on z (the last equality is true because of (5)), where we define for each I the map 
hi:V ^ K" as: 

hi{z) := 0(2£o + si(z) + ... + Sfe(z),a;°,7(w;(z, •))) • 

Indeed, we start by noting that we may assume, without loss of generality, that there is some T > 
such that the final times are equibounded: 

2eo + si(z) + . . . + Sk{z) < T for aU z G V 

(take a smaller, relatively compact, neighborhood V of x' if necessary). In general, the following contin- 
uous dependence result holds for the system x — /(x, u), a compact subset iiT C U, and any fixed integer 
k: there is a function a : M>o -^ IR.>Oj with a{s) ^ as s -^ 0, such that, whenever u,v are two inputs 
with values in K and of equal length Tq < T, which differ in at most fc + 1 intervals of length A, then 

\\cj){To,x'>,u)-^{To,x'>,v)\\ < a{A). 

This is proved by induction, using continuity of trajectories with respect to initial conditions and to 
controls with uniform norm ([13], Theorem 1). We may apply this general fact, for each z CzV, and each 
I, to u = uji^z, •) and v = uj{z, •), since property 2 above says that these differ on at most fc + 1 intervals, 
each of length less than 2/1. So the convergence (6) holds, since for each £ > we may simply pick I 
large enough so that a{2/l) < e, which then gives ||/i;(-^) ~ ^11 < ^ fo'^ *^1 z G V. 

Finally, we note another general fact (which appears often in control theory, notably in connection to 
the "Brunovsky-Lobry Lemma" ) : if 1/ is an neighborhood of a point x^ G M" , then is an £ > such that 
every continuous map h : V ^ R" which is £-close to the identity must contain a neighborhood of x' in 
its image. (Proof: without loss of generality, we may take x^ = 0. Replace y by a subset, some closed 
ball Bp of radius p > about zero. Now take any e G (0, p). Suppose that \\h{x) — x\\ < e for all x E V. 
Then every p G Bp-i^ is in the image of h: for such a p, consider the map H{x) :— x ~ h{x) + p; then 
H maps Bp into itself, and hence by Brouwer's Fixed Point Theorem there is some x so that H{x) = x, 
which means that h{x) = p as we wanted to prove.) Applied to the above maps hi, which converge 
uniformly to the identity, we conclude, in particular that there are I and zq G T^ such that 

0(2£o + Si(zo) + ... + Sfe(zo),a:°,7(w;(zo,-))) = a;'. 

Since both functions 7 and uji(zq, •)) are continuously differentiable, we may write 7(a>((zo,t)) = y" + 
L v{s)ds for some bounded measurable (in fact, continuous) function u : R ^ M™. As a control applied 
to the cascaded system (4), v steers {x'^,y'^) to (x^,y'). 

Since we had picked arbitrary (x", y^) and (x', y'), this completes the proof of controllability. I 

We now complete the proof of Theorem 3. From Theorem 1 and Theorem 5, we know that the 
cascaded system 

i(i) = e^^'^Axit) + By{t)) 

m = V (7) 

is globally controllable. 



Now take any two states z'^, z^ G M" for the system (2). Since rank [A, B] = n, there are pairs {x^ , j/°) 
and (a;'', y^) in R"+" such that Ax° + By° = z° and Ax^ + By^ = z^. Let v : [0, T] -^ R" be any control 
steering {x^,y^) to {x^,y^), along a trajectory {x{-),y{-)) of system (7). Let z{t) := Ax{t) + By{t). This 
is an absolutely continuous function which satisfies z(0) — z^ and z(T) — z . Moreover, its derivative is 
Ax + By — A6^"'>{z) + Bv, so w is a control steering z° to z^ for the system (2). I 

5 Two Dimensional Recurrent Nets 

From now on, we will assume, for simplicity, that in addition to 9 G 0, also 9 is continuously difFerentiable, 
and satisfies 9'{s) > for all s eM., 9' is decreasing to zero on [0, cx)), ^'(0) = 1, and 9oo ~ 1- Note that 
the standard example 9 = tanh satisfies these properties. Furthermore, in this section, all recurrent nets 
are two- dimensional and single-input (n ~ 2, m ~ 1). 

When B = (bi, 62) ^ B„^i, we may assume after a rescaling of inputs, changes of variables x -^ —x 
or y -^ —y, and/or exchanges of variables, that one of these cases holds: 

1. B = (0,0)T 

2. B = (0,1)'^ 

3. S = (l,ir 

and in the first case we don't have controllability. In the remaining two cases, under a further feedback 
transformation of the type u ^t ax + hy + u' , where u' is a new control, one may transform a recurrent 
net, while preserving controllability properties, into one of the two canonical forms: 



(8) 



or 



X - 


= 9{ax + by) 


y = 


-- d{u) 


X - 


= 9{ax + u) 


y = 


= 9{hy + u). 



(9) 
We now characterize controllability for each of these forms. 

Proposition 5.1 The system (8) is controllable if and only if \a\ < \b\ and 6 7^ 0. 

Proof. First we prove the necessity part. Obviously, if 6 = the system is not controllable. So we can 
assume that \a\ > |6| > 0. There are two cases to consider: 



a > In this case, since ^oc = 1, we may find ^ > such that a9{z) > \b\ for all z > A. Then, 
the set {(x,2/) (^ M? \ax + by > A} is forward invariant for the system (8), which therefore cannot be 
controllable. 



a < We consider the system obtained by reversing time in (8) and redefining the control as —u: 

X =^ 9{—ax — by) 

y - e{u') (10) 

(note that, since 9 is an odd function, we may write —9{ax + by) — 9{—ax — by) and —9{u) — 9{u'), 
where we think of u' :— —u as a new control). Since (10) is not controllable, (8) is not controllable 
either. 

We now turn to the sufficiency part. To prove controllability, it is enough to show, for any system 
that satisfies \a\ < \b\ and 6^0, that the system is null-controllable, i.e., every state can be steered 



to 0. Indeed, suppose that this general fact has been estabhshed. Now to steer a state back from to 
any other state {x,y), one may consider the system (10). This also satisfies the hypotheses and hence is 
null-controllable. We find a control u that steers the state of this new system from (x, y) to 0, and then 
apply —u to the original system with the time reversed, to drive to (x, y). So we can steer any state to 
any other, by first passing through the origin. Moreover, since 6 7^ 0, the system is locally controllable 
around the origin, and so it suffices to prove that every state x can be steered into any arbitrarily chosen 
neighborhood of (asymptotic null-controllability) . 

We start with the case a = 0. Take any neighborhood V of the origin, and pick any state (x, y) G K^. 
It is clear that there is some control that steers this state to some new state of the special form (a;', 0). 
If this state is in V , we are done. Otherwise, we have x' 7^ 0. We will assume without loss of generality 
that x' > 0, the argument for x' < being analogous. We next steer our state to a state of the form 
(x", —6), along the trajectory (^,77). Let 

to := inf{t > | br]{t) < 0} . 

Then, ^(io) = x' + J^° d{br]{t))dt > and 77(^0) = 0. By the definition of to and the continuity of ^, we 
may choose ti > ig such that ^{ti) > 0, bT]{ti) < and (0,77(^1)) G V. Thus, we can steer our initial 
state to the state (^(ii), 77(^1)), and after that apply the control = 0. The system will reach the state 
(0, 77(^1)) in finite time. This completes our proof for the case a = 0. 

Now we assume that < \a\ < \b\, and show asymptotic null-controllability. Through a change of 
variables 

X = ax + by 

y = y 

and V — 0{u), the system (8) becomes as follows: 

X — a 9{x) + bv 

y = V (11) 

with control value space (—1, 1). The original system (8) is asymptotically null-controllable if and only 
if (11) is. Thus, we now prove that (11) is asymptotically null-controllable. If a < 0, then we simply steer 
77 to and then use the identically zero control, which makes x go to asymptotically while "freezing" y 
at zero. So we only need to deal with the case a > 0. Moreover, we may assume without loss of generality 
that 6 > 0. If this were not the case, we change variables again, making y' := —y and using the new 
control v' :— —v, which brings the system into the above form with b replaced by —b. In summary, we 
have < a < fe from now on. 

We start by defining the following set: 

n :== {(x, 77) I X > 0, 7/ > 0, X + 077 e{x) < by} . 

We claim that every initial state (x°,77°) G O can be steered to the origin asymptotically. To see this, 
we first apply the feedback control 



by° 



to obtain the closed-loop system: 



ax° 



H?T^(^) 



'-by' 
"^° ^(x). (12) 



no 



" x° - by- 

Let {£,,7]) be the trajectory of (12) that corresponds to the initial state ^(0) = x°, 77(0) = 7/°. Since 
x° > and x" — by'^ < —axpOixP) < 0, it follows that ^(t) -^ monotonically as i ^ 00. Consider 



the function a{t) :~ y'^S,{t) — x'^ri{t). Then, from the form of the equations, it foUows that a — and 
a(0) = 0. Thus a = 0, so r](t) = (y7^°)C(*) ^ as well. 

By definition of fJ, < ay'^9{x'^) < hy^ — Sp . Since ^ is decreasing, we have that 6{S,{t)) < 0(x") for 
all t > 0. So 



°*°^«(«')) 



< 1 



0_5yO 

for all t > 0, so the control v takes values in (—1, 1), as required. This proves the claim. Moreover, the 
same claim is also true for — f7, because of the symmetry of the system (that is, if we change variables 
x' :— —X, y' :~ — y, and v' :— — w, the system equations are the same but Q, gets transformed into — O). 

Now suppose given an arbitrary state (x^,!/") S R^. We first steer it to some state of the form 
(0,i/i). This can always be done with controls bounded by one, because a < b. If yi = 0, we are done. 
Otherwise, if j/i > 0, we steer it to some {x2,y2) G fl. If j/i < 0, we steer it to some (x2,y2) G — ^• 
These motions can be accomplished by the application of a short duration control, positive or negative 
respectively. By the claim proved above, we may then steer (x2, j/2) to the origin asymptotically. I 

Proposition 5.2 The system (9) is completely controllable if and only if a 7^ 5. 

Proof. We first show the necessity statement. Suppose that a = b, and consider the initial state (0,0). 
Pick any control u, and let ^ be the solution of x = 9{ax + u) with ^(0) = 0. By uniqueness of solutions, 
(^, £,) is the trajectory for the entire system with the initial state (0, 0). Thus any state (x, y) reachable 
from (0, 0) must have x — y, and the system is not controllable. 

Now we turn to proving sufficiency when a ^ b. Arguing exactly as before, it suffices to prove 
asymptotic null-controllability, because the condition a 7^ & is again satisfied for the time reversed 
equations (a -^ —a and b -^ — fe), and the linearization at the origin is controllable due to the condition 
a ^ b. We may further assume (exchange equations if necessary) that a > b. There are two cases to 
consider: 



b> G| Here a > 6 > 0. Let 

O := {{x, y) eR^ \ < x < y, ax > by} . 

Claim 1: Pick (x°,y'^) G il. Then, there is a C^ function 

A: : (G,oo) ^M 

which has the following property: 

y°9{sax° + k{s)) - x°e{sby° + k{s)) = for all s £ (0, 00) . (13) 

Indeed, we consider the following function: 

f{s,u) ■- y"9{sax" +u)-x°9{sby° + u). 

For each fixed s, /(s, — oo)/(s, 00) = — (x° — y°)^ < 0. So there exists some u = k{s) such that 
/(s, k{s)) — 0. Moreover, for each u e M for which /(s, u) = 0, necessarily 

^{s,u) > 0. (14) 

To verify this, take any u so that f{s,u) = 0. Since ax'^ > by'^, also 

9{sax° +u)> 9{sby° + u) 

and therefore 

x°9{sax° + u)> x°9{sby° + u) = y°9{sax° + u), 
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where the last equahty foUows from (13). This implies that (x'^ — tf')9{sax^ + u) > 0, which, since 
x^ — if <Q, means that 

sax^ + u < 0. (15) 

We know, then, that sby'^ + u < sax'^ +u < 0. The derivative 9' is increasing on (— oo, 0] (since 9 is odd 
and we assumed that 9' is decreasing on [0, oo)), so 

< 9'{sby° + u) < 9'{sax° + u) 

Multiplying this inequality by x^ < y*^ gives (14). We conclude that u — k{s) is the unique solution of 
the equation /(s,u) = and, by the Implicit Mapping Theorem, that fc is C^. So Claim 1 is proved. 

Claim 2: Any (a;°,y'^) G fl can be controlled to the origin asymptotically. 

To prove this, we apply the feedback control u = k{x/x'^). Let ^ solve ^ = 9(a^ + k(S^/x'^)) with 
^(0) = x''^. Notice that u is well-defined (the argument of k is positive) at least for small t > 0, since 
l{0)/x° = 1. We let, for all t so that C(t) > 0: 

Thus, a^{t) — s{t)ax'^ for all such t. Now we let ri{t) :— y'^.s(t). It follows that 

V = ^i= yO ^ ^ ^ ^0(,sax" + fc(s)) 

x" x" x" 

which in turn equals 9{sby'^ + k{s)) by (13). So, substituting y'^s{t) = ?7(0i ^^ have that i) ~ 9{b'q + k(s)). 
Thus {£_, rj) is the trajectory with (^(0), r]{0)) — (x°, y'^), as long as £,{t) remains positive. Moreover, (15) 
insures that a^ + k{s) < 0, so ^ < whenever ^ > 0. This implies that ^(i) — > as i increases (it could 
be the case that ^ becomes zero in finite time, or ^{t) -^ as t ^ oo), and, so also i]{t) — y^£,{t)/x^ 
approaches zero. This proves Claim 2. 

Observe that the same claim holds true for —ft, because of the symmetry of the system (that is, if 
we change variables x' := —x, y' := —y, and u' :— —u, the system equations are the same but fl gets 
transformed into —fl). 

Finally, take an arbitrary (x", y°) G M^. Suppose that this point is not already in illj(— fi) lj{(0i 0)}- 
We may first steer this point to a state of the form (0, yi). (This can obviously be done, for instance by 
first using u = —ax^x to bring x close to zero, and then using local controllability of the first equation). 
li yi — 0, then we are done. 

Suppose 2/1 > 0. If we apply u = 1 thereafter, ^(t) -^ oo and ri{t) -^ oo along the ensuing trajectory 
(because the right-hand side in each of the equations in (9) is bounded below by 9{1) > 0). We evaluate 
the limit of ^/ry using L'Hopital's rule. We have that ^ — 9{a£^ -I- 1) ^ 1 and either ry ^ 1 (if 6 > 0) 
or 77 ^ 0(1) (if fe = 0), so in either case the limit in question is > 1. Since a > b, aS^ — brj eventually 
becomes positive. Let to be infimum of the i > so that a^(i) — brj{t) > 0. For t < t^, 

m - 9{am + 1) < d{bv{t) + 1) = m 

so ry — ^ increases while t < Iq. Thus //(io) — ^(^0) > 2/i > 0, and so for some small t > to we have that 
ri{t) > ^{t) and a^{t) > bri{t), so (^,77) enters il. If yi < 0, we may apply u = — 1 and conclude that we 
eventually enter — f2. In any case, we can then steer the state of the system to zero asymptotically. This 
completes consideration of the case 6 > 0. 



6<0 



In this case we may first steer a; to and subsequently apply the identically zero control. The y 



coordinate will go to asymptotically, while x is "frozen" at zero. 
This completes our discussion of the two cases. 
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